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A  Branch  and  Bound  Based  Heuristic  for  Solving 
the  Quadratic  Assignment  Problem 


M.  S.  Bazar aa  and  0.  Kirca 


Abstract  • 


~^In  this  paper  a  branch  and  bound  algorithm  is  proposed  for  solving  the 
quadratic  assignment  problem.  Using  symmetric  properties  of  the  problem,  the 
algorithm  eliminates  "mirror  image"  branches,  thus  reducing  the  search  effort. 
Several  routines  that  transform  the  procedure  into  an  efficient  heuristic  are 
also  implemented.  These  include  certain  2-way  and  4-way  exchanges,  selective 
branching  rules,  and  the  use  of  variable  upper  bounding  techniques  for  enhanc¬ 
ing  the  speed  of  fathoming. 

The  computational  results  are  quite  encouraging.  As  an  exact  scheme,  the 
algorithm  solved  the  12  facility  problem  of  Nugent  et  al  and  the  19  facility 
problem  of  Elshafei.  More  importantly,  as  a  heuristic,  the  procedure  produced 
the  best  known  solutions  for  all  well-known  problems  in  the  literature,  and 
produced  improved  solutions  in  several  cases. 


This  research  is  supported  under  NSF  grant  ENG-79-03375  and  ONR  grant 
N00014-80-k-0709. 


1.  INTRODUCTION 


The  quadratic  assignment  problem,  as  given  by  Koopmans  and  Beckmann 
(1957),  can  be  formulated  as  follows: 


m  m  m  m 

Minimize  l  l  l  l  f  ikdllxi1xlc£ 

i=l  j=l  k=l  1=1  J  J  **- 


(1) 
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Subject  to:  J*  x..  *  1 
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Xij  5=2  ®  or  3.  i,j=l,...,m 
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The  above  problem  can  be  interpreted  as  follows.  There  are  m  indivisi¬ 
ble  objects  to  be  assigned  to  ra  indivisible  locations,  where  f  is  the  flow 
or  interaction  between  objects  i  and  k  and  is  the  distance  between  loca¬ 
tions  j  and  Z.  The  objective  is  to  assign  the  objects  to  the  locations  such 
that  the  sum  of  pairwise  interactions  among  objects  weighed  by  the  distance 
between  their  respective  locations  is  minimized.  Without  loss  of  generality 
it  is  assumed  that  the  interaction  and  distance  matrices  are  symmetric. 


There  exists  two  approaches  for  solving  the  quadratic  assignment  problem 
exactly.  The  first  approach  utilizes  the  concept  of  branch  and  bound  or  im¬ 
plicit  enumeration,  as  in  the  works  of  Gilmore  (1962),  Lawler  (1963),  Graves 
and  Whinston  (1970),  Bazaraa  and  Elshafei  (1979),  Burkard  and  Stratmann 
(1978),  Roucairol  (1978) ,  Pierce  and  Crowston  (1971),  Land  (1963),  and  Gavett  and 
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Plytcr  (1966).  Secondly,  through  an  appropriate  transformation,  the  problem 
can  be  reformulated  as  a  linear  mixed-integer  program  which  is  solved  by  cut¬ 
ting  planes  or  by  a  suitable  mixed-integer  programming  package.  The  algorithms 
of  Bazaraa  and  Sherali  (1980),  Kaufman  and  Broeckx  (1978),  and  Love  and  Wong 
(1976)  fall  into  this  class. 

Due  to  the  complexity  of  the  quadratic  assignment  problem,  in  general, 
none  of  the  above  methods  can  solve  problems  with  dimension  m  >  15  effectively. 
Thus  for  larger  problems,  a  considerable  amount  of  effort  has  been  given  to 
the  development  of  inexact  methods  that  obtain  good  quality  solutions  with  a 
reasonable  computational  effort.  A  comprehensive  survey  of  inexact  methods 
can  be  found  in  the  works  of  Sherali  (1979)  and  Burkard  and  Stratmann  (1978) . 

A  summary  of  inexact  methods  for  solving  the  quadratic  assignment  problem  is 
given  below. 

a)  Construction  Methods 

Starting  with  a  partial  solution  or  the  null  assignment,  a  complete 
assignment  is  reached  iteratively  by  locating  one  or  more  objects  at  each 
iteration. 

b)  Improvement  Methods 

Starting  with  a  complete  assignment  of  objects,  an  improvement  over 
the  incumbent  objective  function  value  is  sought  by  interchanging  the  loca¬ 
tions  of  several  objects.  The  procedure  is  terminated  when  no  further  im¬ 
provements  are  possible. 

c)  Hybrid  Methods 

Methods  in  this  class  combine  several  features  of  exact  and 


inexact  procedures. 


According  to  the  computational  experience  reported  in  the  literature* 
it  seems  that  hybrid  methods  are  emerging  as  the  most  successful  approach 
for  solving  large  quadratic  assignment  problems.  Examples  of  such  procedures 
are  the  methods  of  Bazaraa  and  Sherali  (1980)  and  Burkard  and  Stratmann 
(.1978)  .  Both  methods  use  an  exact  solution  scheme  in  conjunction  with  some 
improvement  procedures.  Bazaraa  and  Sherali  implement  Benders'  partitioning 
method  to  a  mixed-integer  formulation  of  the  problem  and  apply  several  im¬ 
provement  procedures  to  the  solutions  found  throughout  the  course  of  parti¬ 
tioning.  The  method  of  Burkard  and  Stratmann  alternates  between  a  branch  and 
bound  (Perturbation)  routine  and  an  exchange  routine  (Verbes)  until  no  better 
solutions  can  be  obtained. 

In  this  paper,  a  branch  and  bound  algorithm  for  solving  the  quadratic 
assignment  problem  is  proposed.  The  main  feature  of  the  procedure  is  the 
elimination  of  "mirror  image"  branches  in  the  search  tree.  The  branch  and 
bound  procedure  is  modified  in  order  to  accelerate  the  computations  result¬ 
ing  in  an  efficient  heuristic  procedure  with  the  following  characteristics: 

1.  Several  improvement  routines  are  used  in  conjunction  with  the  branch 
and  bound  scheme.  The  extent  of  using  these  improvement  routines  is  a  func¬ 
tion  of  the  branch  and  bound  tree  level. 

2.  Several  heuristics  are  utilized  to  eliminate  the  search  effort  at 
branches  which  are  likely  not  to  lead  to  objective  value  improvements.  Fur¬ 
thermore,  variable  upper  bounds  are  used  to  reduce  the  number  of  solutions 
examined , 

The  computational  results  are  quite  encouraging.  As  an  exact  procedure, 
the  algorithm  solved  the  12  facility  problem  of  Nugent  et  al  (1968)  and  the 


dratic  assignment  problem. 
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2.  AN  EXACT  BRANCH  AND  BOUND  PROCEDURE 

Branch  and  bound  procedures  for  the  quadratic  assignment  problem  can  be 
classified  into  single  assignment  algorithms,  pair  assignment  algorithms,  and 
pair  exclusion  algorithms.  At  each  stage  of  a  single  assignment  algorithm, 
one  unassigned  object  is  assigned  to  an  unoccupied  location.  The  procedures 
of  Gilmore  (1962) ,  Lawler  (1963) ,  Graves  and  Whinston  (1970) ,  Burkard  and 
Stratmann  (1978) ,  and  Bazaraa  and  Elshafei  (1979)  are  some  examples  of  single 
assignment  algorithms.  The  pair  assignment  algorithms  proceed  by  simultane¬ 
ously  locating  two  unassigned  objects  to  two  vacant  locations.  The  proce¬ 
dures  proposed  by  Land  (1963)  and  Gavett  and  Ply ter  (1966)  are  of  this  type. 
Pierce  and  Crowston  (1971)  proposed  a  pair  exclusion  procedure  where  the 
algorithm  proceeds  on  the  basis  of  a  stage-by-stage  exclusion  of  assignments 
from  a  solution  to  the  problem. 

The  proposed  procedure  is  of  the  single  assignment  type  where  the  follow¬ 
ing  general  approach  is  pursued.  Let: 

X  =  {x:  x  satisfies  (2),  (3),  (4)} 

I  =  set  of  assigned  objects 

I  =  complement  of  I,  that  is,  set  of  unassigned  objects 
0(i)  =  location  to  which  object  i€l  is  assigned 
J  =  (o(i) :  iel} 

J  =  complement  of  J,  that  is,  set  of  vacant  locations 
p  -  CI,J)  =  { (i ,cf(i) ) :  id} 

Xp  =  (x:  xeX  and  x  «  1  for  all  (i,j)cF} 
y*  =  upper  bound  on  the  value  of  the  objective  function 
IT*  =  assignment  vector  of  the  objects  corresponding  to  the 
upper  bound  y*,  tt*£X. 
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At  each  stage  of  the  procedure,  we  select  a  partial  assignment  of  objects 
I  and  locations  J  that  form  the  partial  assignment  set  P.  The  set  Xp  is  then 
partitioned  into  ,"*,Xp  such  that: 


if  kf£;  k,£=l,  . . .  ,n 


n 

u 


k=l 


=  xp 


For  a  selected  partial  assignment  Pl  ,  a  lower  bound  Z  is  computed.  If 

~~  Me 

Z  y*  then  P  is  fathomed,  that  is,  discarded  from  further  considerations, 
k  k 

Otherwise,  a  complete  assignment  7 r  is  sought  and  its  corresponding  objective 

Pk 

value  y  is  calculated.  If  y  <  y*  then  y*  and  tt*  are  updated  to  yL,  and 
Pk  Pk  Me 

TT  ,  respectively.  The  above  procedure  is  repeated  until  no  partial  assign¬ 
ee 

X 

ment  P  whose  lower  bound  is  less  than  y~  can  be  found. 

The  process  of  partitioning  the  Xp  into  Xp  ,  Xp  , • *  * ,Xp  is  referred  to 
as  branching  from  the  node  representing  the  partial  assignment  P.  The  number 
of  objects  in  the  partial  solution  is  called  the  level  of  the  tree.  The 
active  nodes  or  active  branches  is  the  set  of  all  partial  solutions  that  have 
not  been  fathomed  or  selected  for  further  branching.  A  branch  and  bound 
scheme  for  solving  the  quadratic  assignment  problem  can  be  fully  described 
by  specifying  rules  for: 

1)  Computing  a  lower  bound  Zp  on  the  objective  value  of  all  completions 
of  a  partial  solution  P. 

2)  Choosing  an  active  node  (partial  solution)  for  branching. 
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3)  Branching  from  a  selected  partial  assignment. 

There  exist  several  lower  bounding  procedures  such  as  those  of  Gilmore 
(1962),  Lawler  (1963),  Graves  and  Whinston  (1970),  Roucairol  (1978),  Edwards 
(1980),  Christofides  et  al  (1980)  and  Frieze  and  Yadegar  (1981).  Considering 
the  strength  of  the  bounds  and  the  computational  effort,  the  procedure  of 
Gilmore-Lawler  seems  to  be  the  most  effective.  This  procedure  is  adopted 
here  and  is  described  briefly  as  follows. 

Given  a  partial  assignment  P  =  (I,J),  the  lower  bound  Z^  is  obtained  by 
solving  the  following  linear  assignment  problem  LAP: 


Z 


P 


Minimum  Y  Y  w. .x. .  +  v_ 

xeXy  iel  jeJ  iJ  P 


where : 


w.  . 


=  2l 

kel 


fikdjo(k) 


+  <  f (i) ,  d(j)  > 


(6) 


f(i)  =  vector  of  interactions  of  object  i  with  other  unassigned 
objects  in  I,  where  the  elements  of  the  vector  are  sorted 
in  an  ascending  order. 

d(j)  =  vector  of  distances  from  location  j  to  other  unoccupied  loca¬ 
tions  in  J,  where  distances  are  sorted  on  a  descending  order. 

Vp  =  ici  kel  fikda(i)a(k) 

<*,  •>:  stands  for  the  inner  product  of  two  vectors. 


In  the  above  linear  assignment  problem,  w^_.  is  a  lower  bound  on  the 
assignment  of  object  i£l  to  location  jeJ.  The  fixed  cost  is  the  value 
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accruing  from  the  current  assignment  of  objects  in  I  to  locations  in  J.  Let 
the  optimal  assignment  of  objects  in  problem  LAP  be  a(.i)  for  iel.  Then: 

1)  Zp  is  a  lower  bound  on  the  objective  value  of  all  completions  of 
the  partial  assignment  P. 

2)  The  quadratic  cost  y p  of  the  solution  TTp  given  below  can  be  used  to 
update  y*  provided  that  yp  <  y*. 


V±j 


0(i)  if  iel 
a(i)  iel 


3.  At  optimality  of  problem  LAP,  a  set  of  Lagrangian  multipliers 
u^  for  iel  and  v_.  for  jeJ  with  the  following  properties,  is  available: 

w! .  =  w , .  -  u.  -  v.  >0  iel,  jeJ 

ij  ij  x  i  —  *  J 

w! .  =  0  if  x.  .  =  1 

x3  xi 

The  reduced  costs  w!  .  for  id,  ieJ  can  be  utilized  to  conpute  lower 
bounds  for  all  branches  emanating  from  the  node  associated  with  the  partial 
solution  P  =  (I,J)  without  the  need  for  solving  new  linear  assignment  problems 
This  procedure  is  called  the  alternative  cost  method  and  has  been  applied  by 
Little  et  al  (1.963)  for  the  travelling  salesman  problem  and  later  used  by 
Pierce  and  Crowston  (1971)  for  the  quadratic  assignment  problem. 

To  demonstrate  the  use  of  the  alternative  cost  principle,  consider  the 
partial  assignment  P  =  (I,J).  Let  b(j)  be  the  object  assigned  to  location 
jeJ  in  the  solution  to  problem  LAP.  Now  consider  the  branch  with  the  partial 
assignment 
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2 . 1  Selection  of  the  Branching  Node 

At  each  stage  of  the  branch  and  bound  procedure, a  partial  assignment  has 
to  be  selected  among  all  active  branches.  The  following  two  strategies  are 
typically  used: 

1)  Depth  First 

Choose  the  active  branch  with  the  least  lower  bound  among  the  most 
recently  created  active  branches. 

2)  Breadth  First 

Choose  the  active  branch  with  the  least  lower  bound  among  all  active 
branches  in  the  current  decision  tree. 


10 


The  attainment  of  good  quality  solutions  early  on  is  of  great  importance 
for  the  quadratic  assignment  problem,  especially  if  the  algorithm  is  even¬ 
tually  used  as  a  heuristic.  Implementing  the  depch  or  breadth  strategies 
alone  is  not  satisfactory.  The  correlation  between  lover  bounds  and  quality 
of  partial  assignments  at  low  levels  of  the  branch  and  bound  tree  is  not 
strong.  Thus  it  is  highly  likely  that  a  depth  strategy  may  select  poor  qual¬ 
ity  branches  to  pursue  initially  so  that  good  quality  solutions  are  obtained 
only  after  a  large  number  of  nodes  is  evaluated.  On  the  other  hand,  high 
levels  of  the  branch  and  bound  tree  are  not  reached  early  on  if  the  breadth 
strategy  is  used.  Since  good  quality  solutions  are  usually  obtained  only  at 
high  levels  of  the  tree,  the  process  of  obtaining  such  solutions  is  also  de¬ 
layed.  For  this  reason,  the  proposed  algorithm  combines  the  two  branching 
strategies.  Particularly,  a  breadth  strategy  is  used  as  long  as  the  tree 
level  L  has  not  reached  for  the  first  time,  where  is  a  suitable  trigger 
parameter.  The  depth  stragegy  is  implemented  if  L  >  L^.  Kith  this  combined 
strategy  many  candidate  good  quality  partial  assignments  are  formed  at  low 
tree  levels.  Starting  with  one  of  these  solutions,  the  depth  strategy  quickly 
finds  good  quality  complete  solutions.  If  is  set  equal  to  0,  then  the  pro-  . 
posed  procedure  reduces  to  depth  first,  and  if  is  set  equal  to  in,  it  reduces 
to  breadth  first. 

The  choice  of  the  trigger  parameter  is  highly  dependent  on  the  dimen¬ 
sion  of  the  problem.  A  large  value  of  increases  the  computer  storage  re¬ 
quirements  as  well  as  delay  the  attainment  of  good  quality  solutions.  Accord¬ 
ing  to  our  computational  experience  and  depending  on  the  problem  size,  values 
of  from  3  to  5  are  found  to  be  satisfactory. 
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2.2.  Branching  from  an  Active  Node 

In  the  proposed  branch  and  bound  procedure,  the  single  assignment  rule 
is  used  for  branching  from  a  selected  active  node.  Particularly,  an  object 
rel  is  selected  and  |j|  branches  each  corresponding  to  ~  1  for  seJ  are 
formed.  As  described  previously,  by  using  the  alternative  costs,  some  of 
these  branches  may  be  fathomed  immediately.  Some  alternative  procedures  for 
selecting  the  particular  object  r  for  branching  are  given  below. 


2.2.1.  Select  object  r  using  alternative  costs 

Alternative  costs  can  be  used  in  the  process  of  selecting  the  branching 
object.  By  the  use  of  alternative  costs,  it  is  possible  to  estimate  the  rate 
of  increase  of  lower  bounds  associated  with  each  object  iel.  An  object  r  in 
I  is  selected  according  to  one  of  the  following  two  rules: 

1)  Maximum  total  alternative  cost  rule 
Choose  rel  satisfying 


I  Y  .  =  maximum  y. 
jeJ  J  iel  jeJ  J 


Here,  object  r  that  results  in  the  maximum  sum  of  all  lower  bounds 
at  the  next  tree  level  is  selected. 

2)  Minimum  number  of  branches  rule 
Choose  rel  satisfying 


)  6  =  minimum  )  6  . 

.  u-z  rs  .  -  .£j-  r l 

jea  iel  jeJ 


where , 


'u 


jo  if  Zp  +  Yy  > 


1  otherwise 
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Here,  object  r  that  results  in  the  minimum  number  of  branches  at  the  next 
tree  level  is  selected. 

The  proposed  procedure  uses  a  combination  of  the  above  rules.  First  a 

branching  object  is  attempted  using  rule  (2).  If  £  5  .  <  | j| ,  then  object 

jeJ 

r  is  selected.  Otherwise  object  r  is  selected  using  rule  (1). 

2.2.2.  Select  object  r  using  a  predetermined  order 

Here  objects  are  ranked  with  respect  to  a  certain  criterion  and  object 
rel  with  the  highest  rank  is  selected.  The  following  are  some  possible  cri¬ 
teria  for  ranking  the  objects: 

1)  Maximum  total  interaction  with  all  objects. 

2)  Maximum  total  interaction  with  unassigned  objects. 

3)  Maximum  total  interaction  with  assigned  objects. 

Our  computational  experience  suggests  that  selecting  objects  using 
alternative  costs  is  superior. 

2.3.  Elimination  of  Mirror  Image  Branches 

Two  assignments  tt^  and  are  mirror  images  in  a  quadratic  assignment 
problem  if  the  following  hold: 

1)  TTj  ^  H2 

2)  <1TT1(i)  TT1(k)  =  dTT2(i)772(k)  f°r  a11  i »^=1 ,  .  .  .  ,tn J  i^k 

In  a  quadratic  assignment  problem  where  the  distance  matrix  corresponds 
to  a  rectangular  layout,  it  is  possible  to  identify  several  mirror  images  of 
a  given  assignment  of  objects.  A  mirror  image  of  an  assignment  can  be  ob¬ 
tained  by  rotating  the  objects  column-wise  or  row-wise  such  that  all  pairwise 
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distances  among  objects  remain  unchanged.  Hence  both  assignments  have  the 
same  quadratic  objective  function  value.  An  example  of  obtaining  mirror 
image  assignments  is  given  for  a  2x4  layout  in  Figure  1. 

The  above  property  holds  for  certain  partial  assignments  also.  Two  par¬ 
tial  assignments  and  =  {1^^^  are  mirror  images  of  each 

other  if  the  following  hold: 

1)  -  I2  -  1 

do1(i)a1(k)  “  da2(i)a2(k)  for  all  i,kel  i#c 

3)  For  every  jeJ,  there  exists  a  location  £eJ2  where: 

<»  ^(w  "  \oo  for  a11  keI 

(±i)  d1(j>  =  d2a) 

Condition  (1)  assures  that  both  partial  solutions  involve  the  same  set 

of  objects.  The  second  condition  asserts  that  all  pairwise  distances  among 

assigned  objects  are  equal  in  both  partial  assignments.  The  last  condition 

states  that  for  an  unoccupied  location  jeJ,  there  exists  another  unoccupied 

location  lel2  such  that  the  respective  distances  to  locations  of  assigned 

objects  and  to  vacant  locations  are  equal.  Obviously*  if  conditions  (1)  (3) 

are  satisfied  then  the  respective  lower  bounds  Z  and  Z  will  be  equal  also. 

rl  2 

Furthermore,  all  higher  level  branches  emerging  from  Pj.  and  P2  will  also 
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Figure  1.  Mirror  images  of  an  assignment  on  a  2x4  layout 
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be  mirror  images  of  each  other.  Thus  whenever  two  mirror  image  partial 
assignments  are  observed,  one  of  the  associated  branches  can  be  fathomed 
immediately. 

A  substantial  reduction  in  the  number  of  partial  assignments  can  be 
achieved  using  the  mirror  image  property.  For  example,  in  the  12  facility 
problem  of  Nugent  et  al  (1968),  at  level  1,  instead  of  forming  12  branches 
it  is  sufficient  to  create  only  4  branches,  resulting  in  a  reduction  of  66% 
in  the  computational  effort. 

The  above  branch  and  bound  procedure,  termed  EXBB,  is  coded  in  Fortran 
IV.  EXBB  is  applied  to  some  standard  quadratic  assignment  problems  in  the 
literature  and  the  computational  results  are  summarized  in  Table  1.  In  Table 
2  these  results  are  compared  with  other  branch  and  bound  procedures.  A  consi¬ 
derable  amount  of  reduction  in  the  total  search  effort  (number  of  nodes  and 
number  of  LAP's)  is  achieved  with  EXBB  for  the  test  problems.  Also  note  that 
for  QAP7  where  the  locations  permit  no  mirror  image  assignments,  the  difference 
between  the  performance  of  EXBB  and  the  other  two  methods  is  not  clear. 


Table  1.  Computational  Results  of  EXBB 


Problem 

Dimension 

m 

Number  of 
Nodes  (1) 

Number  of 
LAP'S 
solved 

Optimal 

Objective 

Value 

Time 

Cpu  Sec  (2) 

Nugent , 

Vollmann 

and 

Ruml 

Problems 

[20] 

QAP5 

5 

3 

3 

25 

.023 

QAP6 

6 

5 

5 

43 

.048 

QAP7 

7 

58  ■ 

36 

74 

.  372 

QAP8 

8 

39 

28 

107 

.466 

QAP12 

12 

3385 

2201 

289 

78.220 

QAP15 

15 

16001 

12269 

575 

(3) 

500.00  v  ' 

Elshafei*  s 
-Emblem  (7.) 

QAP19 

19 

767 

715 

_ _i 

8606274 

109.027 

(1)  Using  branching  object  selection  strategy  alternative  costs  as  described  in 
Section  2.2.1 

(2)  On  a  CDC  Cyber  70  Model  74-28/CDC  6400 

(3)  Terminated  at  that  time  without  verifying  optimality 


Table  2.  Comparison  of  EXBB  with  some  other  Branch  and  Bound  Procedures 


Problem 

. 

ESEB 

Burkard  and  Stratmann 
(1978) 

Bazaraa  and  Elshafei 
(1979) 

Number  of 
Nodes 

Number  of 
LAP' s  Solvec 

Number  of 
Nodes 

Number  of 
LAP's  Solved 

Number  of 
Nodes 

Number  of 
LAP's  Solved 

QAP5 

3 

3 

Not 

Available 

8 

20 

14 

QAP6 

5 

5 

Not 

Available 

25 

67 

36 

QAP7 

58 

36 

No  t 

Available 

28 

73 

40 

0AP8 

39 

28 

Not 

Available 

189 

235 

141 

QAP12 

3385 

2201 

Not 

Available 

15575 

37531 

26368 

3.  AN  INEXACT  METHOD  BASED  ON.  BRANCH  AND  BOUND 


When  the  exact  branch  and  bound  procedure  is  applied  to  the  test  pro¬ 
blems  in  the  last  section,  it  is  observed  that  the  optimum  solutions  are 
reached  early  on  in  the  search  procedure.  As  shown  in  Table  3,  the  remaining 
effort  is  spent  to  prove  optimality  of  the  solution. 


Table  3.  Effort  Spent  to  Prove  Optimality 


Problem 

Total 
number  of 
nodes 

Node  #  at 
which  optimal 
solution  is 
found 

%  effort 
spent  in 

proving  optimality 

QAP7 

58 

6 

89 

QAP8  j 

39 

13 

66 

QAP12 

3385 

535 

84 

QAP19  ‘ 

767 

78  i 

89 

In  this  section,  several  improvement  routines  and  methods  of  eliminating 
certain  branches  which  are  likely  not  to  produce  good  quality  solutions  are 
discussed.  With  these  modifications,  the  branch  and  bound  scheme  is  trans¬ 
formed  into  a  heuristic  that  produces  good  quality  solutions  within  a 
reasonable  computational  effort.  The  major  revisions  to  EXBB  are: 

1)  In  order  to  improve  the  quality  of  upper  bounds,  exchange  routines 
are  applied  to  the  LAP  solutions  at  certain  branches  in  the  search  tree. 

2)  Since  it  is  not  possible  to  exhaust  the  search  tree  for  large  pro¬ 
blems,  several  heuristics  are  developed  for  discontinuing  the  search  at 


i 


A 
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branches  where  improvements  are  not  likely  even  if  the  lower  bounds  indicate 
that  fathoming  is  not  yet  achieved. 

3.1.  Application  of  the  Exchange  Routine 

An  attempt  to  improve  the  quality  of  the  upper  bound  is  made  by  apply¬ 
ing  an  exchange  routine  to  some  of  the  LAP  solutions  obtained  in  the  lower 
bounding  process.  The  application  of  the  improvement  routine  to  all  LAP 
solutions  is  not  advisable.  Especially  at  low  levels  of  the  tree*  the  qual¬ 
ity  of  the  LAP  solutions  is  not  good,  so  that  even  with  the  exchange  routine 
it  is  usually  not  possible  to  update  the  upper  bound. 

Two  levels  and  where  v  c  ,  *  elected.  These  parameters  are 
used  to  trigger  the  exchange  algorii:^  :  allows: 

1)  At  levels  L  <*  the  exchange  )/;utine  is  applied  to  all  LAP  solu¬ 
tions.  Even  though  at  this  stage  it  is  not  likely  to  obtain  good  quality 
solutions,  the  exchange  routine  is  implemented  in  order  to  improve  the  solu¬ 
tions  for  use  in  conjunction  with  the  variable  upper  bounds  (Section  3.5). 

2)  At  levels  <  L  <  n^,  the  routine  is  applied  only  at  the  branch 
that  has  the  least  objective  function  value  yp  among  all  the  branches  at 
that  level. 

3)  At  levels  L  >  n^,  the  routine  is  applied  at  all  branches  in  the 
hope  of  improving  the  quality  of  solutions  at  hand. 

A  suitable  choice  of  the  parameter  n^  is  1  and  a  good  value  of  is 
around  ra/2. 
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3.2.  The  Exchange  Routine 

Most  of  the  improvement  algorithms  available  in  the  literature  utilize 
2-way  exchanges  with  different  implementation  strategies.  Some  routines  also 
use  the  higher  order  3-way  and  4-way  exchanges.  Los  (1978)  and  Burkard  and 
Stratmann  (1978)  discussed  some  procedures  which  employ  higher  order  exchanges 
and  conclude  that  the  extra  effort  spent  is  not  worthwhile. 

In  general, 4-way  exchanges  are  computationally  very  expensive.  Given 
an  assignment  of  four  objects  (i,k,p,q),  there  are  23  different  additional 
permutations.  Mirchandani  and  Obata  (1979)  showed  that  out  of  these  23  permu¬ 
tations,  6  can  be  obtained  by  2-way  exchanges  and  8  can  be  obtained  by  3-way 
exchanges.  Thus,  only  9  permutations  require  4-way  exchanges.  Three  of  these 
remaining  9  permutations  can  be  easily  computed  by  making  use  of  2-way  exchanges. 

The  simultaneous  exchange  of  locations  of  two  pairs  of  objects  is  called 
a  2x2-way  exchange.  Specifically,  consider  two  pairs  of  objects  (i,k)  and 
(p,q).  Let  A(i,k)  and  A(p,q)  be  the  change  in  the  objective  function  value 
for  the  2-way  exchanges  of  these  two  pairs  of  objects,  respectively.  Then 
the  net  change  A(i,k,p,q)  in  the  objective  function  value  resulting  from  ex¬ 
changing  the  locations  of  objects  i  and  k  and  those  of  p  and  q  is  given  below: 

A(i,k,p,q)  =  A(i,k)  +  A(p,q) 

+  ^ip+ fkq  fkp  <'tla(k)a(p)+ da(i)a(q)  da(i)a(p)  ~  da(k)a(q)^ 

where  a(i)  is  the  location  of  object  i  in  the  current  assignment. 


The  exchange  routine  implemented  in  this  study  evaluates  2~way  and  2x2-way 
exchanges  in  the  following  way: 

1)  First  improvement  rule  is  adopted*  That  is,  the  first  exchange  that 
yields  an  improvement  is  implemented. 

2)  An  exchange  of  two  objects  is  considered  only  if  the  distance  between 
their  respective  locations  does  not  exceed  a  certain  parameter  X. 

3)  The  objects  are  ranked  according  to  total  interactions,  and  exchanges 
are  performed  starting  with  objects  at  the  top  of  the  list. 

Using  the  above  rules,  2-way  exchanges  are  first  performed  until  no  im¬ 
provements  can  be  obtained.  Then  2x2-way  exchanges  are  evaluated.  If  any 
2x2-way  exchange  results  in  a  smaller  objective  value,  the  routine  is  reiniti¬ 
ated  using  2-way  exchanges  starting  from  the  improved  solution.  This  proce¬ 
dure  is  terminated  when  no  improvements  are  possible  using  the  2x2-way  exchange 
routine . 

3.3.  Selective  Location  Rule 

In  optimal  or  good  quality  solutions  it  is  generally  expected  that  objects 
with  large  total  interaction  are  assigned  to  "median"  locations  while  objects 
with  small  total  interaction  are  assigned  to  "off-median"  or  corner  locations. 
While  branching  from  a  partial  assignment,  new  branches  are  created  by  assign¬ 
ing  the  selected  object  to  each  of  the  vacant  locations.  The  assignment  of  a 
high  interaction  object  to  a  corner  location  is  likely  not  to  lead  to  a  good 
quality  solution,  even  if  the  lower  bound  does  not  exceed  the  incumbent  objec¬ 
tive  value.  In  general,  a  substantial  computational  effort  may  be  expended 
in  pursuing  such  "bad"  branches.  By  the  selective  location  rule,  high  inter¬ 
action  objects  are  assigned  only  to  "cental"  locations  and  low  interaction 


objects  are  assigned  to  uof i'-median"  locations.  Obviously,  there  is  no  guar¬ 
antee  that  all  optimal  or  good  quality  solutions  must  satisfy  these  additional 
restrictions,  but  it  is  hoped  that  the  exchange  routine  would  help  overcome 
this  difficulty. 

The  objects  and  locations  are  ranked  according  to  non-increasing  total 
interactions  and  non-decreasing  total  distances,  respectively.  A  parameter  t 
is  chosen  and  f;  each  object  i,  the  set  of  permissible  locations  is  deter¬ 

mined  as  follows.  Let  i*  be  the  rank  of  the  object  i.  Then: 


=  {J:  i*  -  t  <  j*  £  i*  +  t} 


where  j*  is  the  rank  of  location  j.  A  good  choice  of  t  is  in  the  range  from 
to/3  to  to/2. 


3.4.  Group  Assignment  of  Objects 


In  an  optimal  solution  we  would  generally  expect  that  the  set  of  objects 


with  large  pairwise  interactions  to  be  located  close  to  each  other.  This 
observation  is  incorporated  in  the  branch  and  bound  procedure  as  follows* 

Choose  a  parameter  e  denoting  the  threshold  percentage  of  total  interactions. 
Suppose  that  at  branch  P  object  r  is  assigned  to  location  s,  and  that  the  solu¬ 


tion  of  LAP  yields  the  complete  assignment  Up •  Then  for  all  iel  satisfying: 


f  . 

n  > 


n 


l 

k=l 


£ 


object  i  is  assigned  to  the  location  TTp(i)  for  all  completions  of  the  current 


partial  assignment  P.  That  is,  P  is  updated  as  follows: 

P  -  P  u  (  (i,1Tp(i)  } 

By  this  procedure  it  is  hoped  to  speed  the  branch  and  bound  scheme  and 
at  the  same  time  generate  good  partial  assignments.  A  suitable  choice  of  £  -is 
around  .25. 

3.5.  Variable  Upper  Bounds 

In  order  to  reduce  the  search  effort,  variable  upper  bounds  are  used. 

Bazar aa  and  Elshafei  (1977)  discussed  fictitious  upper  bounding  procedures 
for  tree  search  algorithms  and  applied  them  to  the  quadratic  assignment  pro¬ 
blem  in  [2].  Also,  Burkard  and  Stratmann  (1978)  implemented  a  variable  upper 
bounding  scheme  to  an  inexact  branch  and  bound  procedure  for  the  same  problem. 
The  concept  of  fictitious  or  variable  upper  bounding  can  be  explained  as 
follows . 

A  branch  is  fathomed  if  its  lower  bound  is  greater  than  or  equal  to  the 
incumbent  upper  bound.  But  in  quadratic  assignment  problems,  the  upper  bound 
usually  exceeds  the  lower  bound  except  for  large  tree  levels.  Thus  a  substan¬ 
tial  amount  of  effort  is  typically  spent  is  pursuing  bad  quality  solutions  be¬ 
fore  fathoming  can  be  achieved.  In  order  to  speed  fathoming,  a  fictitious 
upper  bound  V(L)  _<  y*  is  set  for  each  level  L  of  the  search  tree.  The  branches 
at  level  L  that  have  a  larger  lower  bound  than  V(L)  are  fathomed.  These  fic¬ 
titious  upper  bounds  are  called  variable  upper  bounds  since  their  values  de¬ 
pend  on  the  tree  level  L,  where  V(L)  _<  V(L  +  1)  for  L=l,  —  ,m-l.  The  variable 
upper  bounds  must  be  such  that  good  quality  branches  are  not  fathomed.  Only 
the  branches  which  are  likely  not  to  produce  improved  solutions  are  fathomed. 
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The  computational  experience  with  variable  upper  bounds  show  that  rela¬ 
tively  good  quality  solutions  are  obtained  early  on  and  further  efforts  either 
do  not  improve  the  current  upper  bound  or  produce  little  improvement.  Since 
for  a  fixed  L,  an  increased  0  results  in  decreasing  V(L)  and  hence  speeding 


the  fathoming  process,  the  parameter  0  is  incremented  by  one  after  evaluating 

certain  number  of  n.jdes.  For  Gilmore-Lawler  bounds,  a  good  starting  value  for 
2 

8  is  around  — m.  Furthermore,  the  branch  and  bound  procedure  is  terminated 
if  no  improvements  over  the  current  upper  bound  are  obtained  within  a  specified 


amount  of  time. 
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The  exact  branch  and  bound  procedure  EXBB  of  Section  2  is  modified  using 
the  above  heuristic  strategies,  resulting  in  the  code  INBB.  A  variant  of  this 
inexact  procedure  that  differs  only  in  the  computation  of  lower  bounds  is  also 
developed.  INRO  uses  Roucairol's  reduction  procedure  [22].  The  basic  idea 
of  Roucairol’s  procedure  is  to  reduce  the  interaction  and  distance  matrices 
so  that  the  quadratic  assignment  problem  is  written  as: 


Minimize 


m  in  m  td  in  to 

I  I  F  1  .x.  »  +  £  l  c.  .x.  .  +  v. 

i=i  j-i  k=i  zii  ik  13  ^  i=i  k-i  13  13  0 


Subject  to:  xeX 
where. 


fik 

Ail 


=  nonnegative  reduced  flow  from  object  i  to  object  k 
=  nonnegative  reduced  distance  between  locations  j  and  £ 
=  reduced  cost  of  locating  object  i  to  location  j 
=  a  fixed  cost  obtained  by  the  reduction  process. 


Ignoring  the  reduced  quadratic  part,  the  lower  bound  Zp  for  a  given  par¬ 
tial  assignment  P  is  computed  by  solving  the  following  LAP: 


=  Minimum  Y  Y  h .  .x .  .  + 

P  11  11  P  0 


X£ 


Xp  iel  jeJ 


where ; 


n  ft 

h.  .  =  c .  .  +  Y  f d . 

ij  13  L  *•* 


kel 


ik  jo(k) 


Vp=  I 


iel 


:ia(i)  +  k^x  fikda(i)a(k) 


Obviously,  the  above  lower  bound  can  be  strengthened  by  computing  a 
lower  bound  on  the  reduced  quadratic  term.  But  our  experience  with  the  test 
problems  suggest  that  including  the  reduced  quadratic  term  into  the  lower 
bound  computations  does  not  necessarily  yield  stronger  lower  bounds  in  com- 

«JU 

parison  with  Gilraore-Lawler  procedure.*  Furthermore  as  far  as  the  total  ef¬ 
fort  is  concerned,  by  including  the  reduced  quadratic  relations  into  the 
bound  computations,  the  computational  advantage  of  Roucairol’s  procedure  over 
the  Gilmore-Lawler  method  is  lost. 

The  modified  branch  and  bound  schemes  INBB  and  INRO  are  applied  to  the 
problems  of  Nugent  et  al  (1968) .  For  each  problem,  the  follox/ing  three  stra¬ 
tegies  for  selecting  the  branching  object  are  used. 

1)  Maximum  total  interaction  with  all  objects 

2)  Maximum  total  interaction  with  already  assigned  objects 

3)  The  alternative  cost  rule  described  in  Section  2.2.1. 

The  computational  results  are  given  in  Table  4.  As  seen  from  the  table, 
even  with  the  weaker  bounding  procedure  INRO,  good  quality  solutions  are  ob¬ 
tained  in  a  relatively  small  amount  of  computational  time.  Furthermore,  it  is 
observed  that  the  selection  rule  of  the  branching  object  does  not  affect  the 
quality  of  the  solutions  significantly.  An  attempt  to  further  improve  the  qual¬ 
ity  of  the  solutions  at  hand  is  made  using  a  routine  that  implements  2,  3,  and 
4-way  exchanges.  This  routine  is  similar  to  the  Mixed  Exchange  Algoritlim  of 
Mirchonduni.  and  Obata  (1979).  FLthv**  very  trie*  improvement  or  none  at  all 

T 

For  problems  that  have  a  rectangular  grid  layout  and  an  interaction  matrix 
with  at  least  one  zero  in  each  row  and  column,  it  can  be  shown  that  Roucairol’s 
procedure  cannot  yield  stronger  lower  bounds  even  if  the  reduced  quadratic 
terra  is  included  in  the  bound  computations. 
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Table  4.  Summary  of  the  Results  for  Nugent  et  al  (1968)  Problems 


Problem 

Dimension 

IT. 

Branching 
Object 
Selection 
Sr  renter  v  _ 

r 

1KR0 

INBB 

Best  known 
value  in 
literature 

r  m 

Value 

Cpu. 

Ser.  (a\ 

Value 

Cpu. 

QAP15 

15 

■9HEH 

11.85 

575 

■39 

575 

32.74 

575 

(3) 

575  !  10.80 

1 

575 

30.59 

QAP20 

I 

20 

(1) 

1297  !  30.75 

* 

1285 

100.00 

(2)  j  1285 

29.50 

1285 

100.00 

1285 

(3)  J  1300 

50.00 

1285 

100.00 

f - - 

j  QAP30 

I  | 

i 

30 

L_ 

{  { 

(1)  |  3079  (  176.19 

I  _  i 

3079 

400.83 

(2)  |  3083  j  139.49 

3080 

346.95 

3077 

(3) 

.. 

3080  j  200.00 

3078 

400.84 

(a)  On  a  CDC  cyber  70  model  74-28/CDC  6400 
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4.  AN  ITERATIVE  APPLICATION  OF  THE  INEXACT  BRANCH  AND  BOUND  PROCEDURE 

One  disadvantage  of  the  proposed  inexact  methods  of  Section  3  is  that 
their  effectiveness  is  highly  dependent  on  the  quality  of  the  initial  partial 
assignments  selected  at  low  tree  levels.  Since  the  search  tree  is  not  ex¬ 
hausted  ,  these  methods  commit  themselves  to  the  partial  solutions  selected  at 
low  levels.  In  order  to  reduce  this  dependency  on  initial  partial  assignments 
the  following  iterative  branch  and  bound  procedure  is  developed. 

The  procedure  applies  the  inexact  branch  and  bound  scheme  iteratively  by 
alternating  between  two  branching  rules.  At  each  iteration,  several  number  of 
objects  are  fixed  at  the  locations  of  the  previous  iteration  and  the  branch 
and  bound  computations  are  performed  by  changing  the  branching  rule.  The  pro¬ 
cedure  terminates  when  no  improvements  are  obtained,  and  is  summarized  as  follows. 

Form  two  ordered  sets  of  objects  S  and  S  such  that: 


in  iu 

l  fi  ki  l  fi  k 

t=l  V  k=l  £+1  ’ 


lli  Ill 

1  fi  k!  I  fi  k 

k=l  XV  k=l  H+v 


for  all  ^  1 , * . •  ,m 


for  all  i^eS  £=l,...,m 


Let  s^  be  a  parameter  corresponding  to  the  branching  object  selection  rule  at 
iteration  q,  where: 

1  select  the  branching  object  having  maximum 
total  interaction  with  all  objects. 

s  = 

q  .  . 

2  select  the  branching  object  having  minimum 
^  total  interaction  with  all  objects. 
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5te£_J):  Set  q*l,  sq=2,  sq=l,  y*=«s  and  -*=0. 

Let  Pq  =  (I(?,JQ)  =  (0,0)  and  go  to  Step  1. 

Stco_l:  Apply  INBB  using  the  branching  rule  sq>  and  starting  with  the  partial 
solution  Pq.  Terminate  the  branch  and  bound  procedure  whenever  the  bottom  of 
the  search  tree  is  reached  for  the  first  time.  Let  the  best  solution  found  be 
y  and  tt  and  go  to  Step  2. 

q 

-§tgp,.?:  It  >  y*  or  y^  =  y^_^  stoP-  Otherwise  go  to  Step  3. 

Step  3:  Let  ,  u*  y  and  tt*=  tt  .  Determine  a  number  k  which  corresponds  to  the 
- c ^  a  q  q 

number  of  objects  to  be  fixed  at  this  iteration.  Set  PQ  =  (iQ,j  )  as  follows: 
r  first  k  elements  of  ordered  set  S  if  s  =1 

q  q 

< 

first  k  elements  of  ordered  set  S  if  s  =2 

q  q 

(tt* (i)  :  ielg) 

Let, 

s  . ,  *■  s 
q+1  q 

S  ,,  +■  s 
q+1  q 

q  «-  q+1 

and  return  to  Step  1. 


The  procedure  terminates  at  an  iteration  q  if  the  objective  value  of  the 
assignment  found  at  that  iteration  is  greater  than  the  incumbent  y*  or  equal 
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to  that  obtained  by  the  previous  iteration  which  has  the  same  branching  rule. 
The  number  of  objects  k  to  be  fixed  at  each  iteration  is  around  m/3. 

q 

The  above  iterative  procedure  is  applied  to  Nugent  et  al  (1968)  and 
Steinberg  (1961)  problems  and  the  results  are  summarized  in  Table  5.  The  pro¬ 
cedure  produced  at  the  best  known  solutions  for  problems  QAP20  and  QAP34-1. 

For  Problems  QAP30  and  QAP34-2  the  iterative  procedure  produced  solutions 
which  are  better  than  the  best  known  in  the  literature.  These  solutions  are 
given  in  the  Appendix. 


I 
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Table  5.  Summary  of  Iterations  for  Nugent  et  al  (1968)  and  Steinberg 
(1961)  Problems  with  Iterative  Branch  and  Bound  Scheme 


1 

Dimension 

m 

I 

Iteration 

q 

Branching 

Order 

s 

q 

Number  of  | 
fixed  f 

cbjectsk  .. 

q-1 

Objective 

value 

Time 

Cpu •  Sec . 
(a) 

Cumulative 

Computation 

Time 

Cpu.  Sec. 

(a) 

Best 

known  in 
literatur- 

[3] 

20 

1 

2 

0 

1303 

52.62 

52.62 

1285 

2 

i 

6 

1298 

28.32 

70.94 

3 

2 

6 

1298 

19.24 

90.18 

4 

1 

8 

1292 

20.37 

110.55 

5 

2 

8 

1285 

20.08 

130.63 

6 

1 

10 

1285 

15.40 

156.03 

30 

j 

1 

2 

0 

3130 

130.53 

130.53 

2 

1 

8 

3072 

61.91 

192.44 

3077 

3 

2 

8 

3064 

67.11 

259.55 

i 

4 

1 

12 

3064 

31.20 

290.75 

5 

2 

12 

3064 

29.50 

320.25 

■ 

1 

2 

0 

7999 

398.22 

398.22 

7926 

2 

1 

13 

7926 

46.56 

444.78 

3 

2 

16 

7926 

62.26 

506.71 

34 

1 

2 

0 

4802 

326.60 

326.60 

2 

1 

13 

4800 

55.87 

382.47 

4802 

3 

2 

lb 

4800 

83.26 

465.73 

_ __l 

(a)  On  CD C  Cyber  70  model  74-2S/CDC  6400 
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